An Expectation Maximization Algorithm to Model Failure Times by Continuous-Time Markov Chains
نویسندگان
چکیده
منابع مشابه
An EM Algorithm for Continuous-time Bivariate Markov Chains
We study properties and parameter estimation of finite-state homogeneous continuous-time bivariate Markov chains. Only one of the two processes of the bivariate Markov chain is observable. The general form of the bivariate Markov chain studied here makes no assumptions on the structure of the generator of the chain, and hence, neither the underlying process nor the observable process is necessa...
متن کاملTechnical Note: An Expectation-Maximization Algorithm to Estimate the Parameters of the Markov Chain Choice Model
We develop an expectation-maximization algorithm to estimate the parameters of the Markov chain choice model. In this choice model, a customer arrives into the system to purchase a certain product. If this product is available for purchase, then the customer purchases it. Otherwise, the customer transitions between the products according to a transition probability matrix until she reaches an a...
متن کاملAn Expectation Maximization Algorithm for Continuous Markov Decision Processes with Arbitrary Reward
We derive a new expectation maximization algorithm for policy optimization in linear Gaussian Markov decision processes, where the reward function is parameterized in terms of a flexible mixture of Gaussians. This approach exploits both analytical tractability and numerical optimization. Consequently, on the one hand, it is more flexible and general than closed-form solutions, such as the widel...
متن کاملAn Expectation Maximization Algorithm for Continuous Markov Decision Processes with Arbitrary Rewards
We derive a new expectation maximization algorithm for policy optimization in linear Gaussian Markov decision processes, where the reward function is parameterized in terms of a flexible mixture of Gaussians. This approach exploits both analytical tractability and numerical optimization. Consequently, on the one hand, it is more flexible and general than closed-form solutions, such as the widel...
متن کاملBayesian Analysis of Elapsed Times in Continuous-Time Markov Chains
We explore Bayesian analysis for continuous-time Markov chain (CTMC) models based on a conditional reference prior. For CTMC models, inference of the elapsed time between chain observations depends heavily on the rate of decay of the prior as the elapsed time increases. Moreover, improper priors on the elapsed time may lead to improper posterior distributions. In addition to the elapsed time, a...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Mathematical Problems in Engineering
سال: 2010
ISSN: 1024-123X,1563-5147
DOI: 10.1155/2010/242567